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ABSTRACT 

A project developed an o{»rational definition of and 
designed a conceptual framework for evaluating two-year postsecondary 
educational customized training programs. The definition specifies 
that customized training requires the following: (1) contracts; (2) 
payments; (3) relationships to economic development strategies; (4) 
the delivery of training designed to ii5>rove work force ctw^tencies; 
and (5) adaptation to the needs of external clients. Four categories 
further differentiate training approaches* custwa-designed courses, 
modification of courses, alternative delivery of courses, and courses 
for special populations. The framework contains sets of variables 
that describe the context for customized training. The variables 
reflect characteristics of employees/employers, institutions, 
cf^unities, and states that provide a basis for the way customized 
training is conducted. The process identifies the client ne^s and 
proceeds through sul^rcwesses: negotiation, job analysis, 
instructional design, implementav.ion , program evaluation, and 
administration. It is necessary tr* focus on the outct^es of training 
and to determine how products are linked to individual outcomes. (30 
references) (NLA) 
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INTRODUCTION 



In the past ten years, two-year postsecondary educational institutions (i.e.. 
commnnity, juiik)r, aiKl technicil colleges and institutBs) have im^easingly offered 
programs md swviccs to tiic private- and public-sector to jstomote economic dcvelopnwnt, 
Ihese ofoinp ind^ tiaifitioiml vooitioiial-tecfaiiical echicatioii (purses, mm-traditionai 
tnining anuses and workdifH>s, consulting servto, and teclmology trai»fcr assistance. 
Of diese {KOdncts and sorvtees, customized tnuning has becone extrenseiy important 
Cusm^ied training, also refened to as contract training, is touted by insiders and 
outdden of postsecoKlaiy edi^r^cm alike as playii^ a majw role in the future human 
r^>uice devdopmoit polki^ of the United States (Blaiu:hard, 1990). Although 
cimmi2ed trailing i^ipevs to malce a valuable contribution, httle systmatic evaluation 
eadsts to explain its in^ <m stetes, conmmnitics, clients, or the two-yw 

educatkm hisdnttkms ttemselves. 

This pro^ exteiKls the work of Grabb and Stem (1989) reported previously in a 
NaticHuU Center for Research in Vocational Eduoition (NCRVE) document entiaed 
Seaming the Wh&tt from the Ou^: The Rok ttf Vocational Educatum in Economic 
OeveUtpmmtt, In that repcm. GruW> and Stem explored tlw philosophical and econonuc 
fimndiaifms for custmnized tr^mng aial other similax vocatiiml education programs 
offered by community colleger. They alw considered the strategic role two-year 

project focused on qpenaimudizing selected <»ncej«s initially cfcvetoped by Gmbb and 
Stem into a dcfinitka and HKKtel of customized training that could be maite avails 

vocational educators. An important goal was to provide state admimsiraiors of 
postsecondary educational sy^ms and local adnrinistratcrs of two-year postsecondaiy 
institBtions with a coittqmial ntfxH fw evaluating custt^^ 
dHiM»»tialtog accounlai^. assessmg hiqwct, and impiov^ 



Purpose of the Project 

This jHOject was deagned to nwve beyomi tlM <tebatc about whether two-year 
postsecondary educatiwial mstitutions make a valuable contribution to the econoixuc 
develcn»nimt of communiliw, stat«, and regions of the United States. This project 
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recognized ttie to^ outondzed traming 1^ plas^^ and omtinues to play in economic 
dev^i^ptnoit strati^ by Iniimvii^ woifcfo^ Tlw primary objectives of 

this pm^ were to devdin» an operational deflidtton of customized tmining that could 
provifte a basis for planning, administering, and evaluating custi»nized training; and to 
design a concqmml fran^work for evaluating customized mining {wograms. For the 
purposes of this project, a ccmceptual fhunework was considered to be a n»ans of 
structming 8^ of variables so that they couM be (tesoribed cleariy and related to specific 
oincom» (Lewis, 1990). The intent of ccmcephial firamewixk was to inovide a modgi 
for gaining a cteara umtotasding of customimi training inograms and for conducting 
evaluations <^ them. 



Need for the Project 

Currently, two-year postsecondary institutions, state agencies, and other 
stakdio^iers in tte educatiimal system use varyin^g ctefinitions fox customized training. A 
titoatuieievkwcoiMhtcted early in th» project su]:poited this. Appaxt»tly. in the effort of 
two-year poMsecomiary hisdtudons to be r^ponsive to business ami industry, an array of 
I»ograms and servicoi are offiered as a part of customized training. Although few 
questions are raised about tt» usefiiliwss of th^ programs in meeting die needs of 
bushiess and industry Okm, com^nis axe son^times rais^ ^ut the adequacy of 
ei^duatkm systems for Inndling sis:h individualized ai^yroaciffis to deUvenog educational 
progranB (GruU> A Stan, 1989). 

The lade of a ci»isi»Bm definitim (tf cuslcmiized nahurig may 1^ 
misinfbriindon among cdteges and f(^dknts,fomto, and policymaicers. Further, the 
lack of a common (tefinition may hinder two-year postsecomiary instimtions from 
ccdiectivdy ddemuning die inq»ct of their cu^onuzed trainii^ 
well-being of communiti^ states, and regions of the country. Since economic 
develoim«it is a pranary driving force bdiind cust«miize^ 

its impact on conamunities and states could jeopardize public support. Two-year 
portsBCiHKlary ioataitkwB «id Ac state admini^ 

way of defining and conceptuaHzittg customized training in a consistent way for the 
piaposes irfevaUiation so that d»y are in a b«ter positicm to demonstrate tte accountable^ 

and impact of these programs. 
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A qiMstiim be asleed as to wheiter it U Messay to 
of custiNDizeil tni^iig isogntns since, fir»|i»ntly, ct»tomized trainiiig is viewed as a 
clieat-drtveD aideavor whcaeby extenal clients detennii» price and quality standards. 
Soii» may ugiK tlitt the sadsfiKtion of extenal citots is the only <mttca^ 
evaluate customized training. To dds end, the atnliois concur that detennination of client 
sads^tkm is bi^mtant, e^eciaUy sto cusiomized traini^ 

inaffeetofti^tting|m)dtK:tsandKrvicesforba»nessa^ Howevn^, we believe it 

isnmsufi^entinandof i^. This a{^o»^ is tnmblesonie in a maricetpl^ that is 
inoeashiglyGfmiidexandcomp^tive. In such a maiketiaMc it tecomra impwative to 
have meaningftd and lipsrousevaluatiwi data that (an be utilized to demonstrate tls impact 
rfl^jgnrasasweUastocoiffiibitetodidrcontimiedimimivenKnt Cnibb (IW) stat», 

tf the mnpose of custwniMd ti^idi« is to imjm«c ec«ii^ 
as measiBed by emfltoymsi& gains in an ar^ earnings increa^s, tirra 
productivity, a«t overall |»odttction (or regional product), dien it is 
insiiflfMff!^ to know timidy whether finm axe pleased widi the results of 
voctfionale(fa»aii(mi»dtrai^i^ C)vertheIongnmitwiUbei»c«i^to 
devdop beit» infimnasicHi aboitt the dfects dm pn^nms, for diffoent 
groups of individuals, umlervaiyinge«nK»nicconditk»ui. (p. 23) 

There aie nianerous ^ific instance wlrai a focus solely on evaluating client 
satisl^OT b imbleniatic. First, some of die tnuning performed by two-year 
po^MCondary institutions involves (mblic fiiiHls to subsidize die cost of training for 
padkular fiiras (e.g., small- and medium-azed firms) w spedfic target populations (e.g., 
displaced woitas). In fliesc circunwtawjei, putriic itaMis are used to create training 
eqwteices for indivkhials who have fwateKdvcqjtions fear ir^ In 
Older tbr qBa»y twining programs to be provided fiw dMse audiei^ 

to be used in ways tiwt prodoix benefits (i.e., improved competencies, increased 
cmptoynom rates), it is iropcmMit diat sysl«n«ic. foraud evaluation proce»cs be appM 
customized na&iiiit* It is imiltoialfc to daimtiiatsin^ because publfcfamb are spent to 
tmfai imfivifhials in a workforce, that bei^cial eronomic devdopment outcomes arc 
produced. CSmbbairiStOTi(l^) have forndtitatfirm-spedfic education airi job tiainm 
do not necessarily 1^ to impioven«nts in trwKtional economic development mtasures 
such as employn«nt rates and gross mdwud product (GNP). The question of cost and 
benefits is nearly always posed wh«i a service such as customized training can be provided 

throng either public or inivaie sources. 



Second, the growth of two-year postsecondary institutions in economic 
devdqpmeiit necessitateg increa^ mim^alHlity in rnshing outcmnes associated with 
in^vtd wofkfcHce quality and prodtK^tivity. Two-year postscccMulary institutions need to 
be able to demonstrate their aaxnmtability for helping business and industry to improve 
their economic comp^veness. Omx two-year post»condary educational institutions 
b^in staking some of thdrieputaticms and energies on serving business and industry, a 
need is created for continual efftets to ensure that valid and positive outcomes arc 
piochM^ 

Similarly to their counterparts in the private sector, two-year postsecondary 
institutions need to offer prodiK^ts that are market driven, high in quality, and continuously 
iroiaoved. Evaluaticm i»ocesses are fumlaroental to ensining that institutions deliver high 
quality cummized training services and maintain their market niche. Kopecek (1984) 
describes ti« importance of formal evaluation in a discussion about the issues surrouncUng 
community coUe^ becmning involved in custmnized job training (CJT). He states. 

Finally, the college that off«s CJT should recognize that all of the factors 
that hM tremendous potential few (teveloping pc^tive relationships with 
Imsiness and imiasny have inhwent in them tlK possibility for exacUy the 
opposiie. Finns expend funds fx training with tte expectation of receiving 
quality in^ruction and service. If t!wsc services are not delivered to the 
level of satisfaction advertised and ^ared, dissatisfection with the college 
is bouiKl to result and to be adv«tised in the community, (p. 15) 

In the long term, formal program evaluation is important because it provides a 
means of documenting tt« contribution of two-year postsecondary educational programs to 
the human resource developn^nt policies and strategics of the United States. Customized 
training does not appear to be a pas»ng fad. Rather, it seems lo be meeting a growing need 
among business and industry for training and educational services. A long-tenn view of 
customized training places it the larger arena of educational programs and services vital 
to a continuing and fundamental commitment to workforce preparation, training, and 
retraining. 

Target Audiences 

The primary target amficnccs arc state and local officiais who have responsibility fca" 
administering and evahiatfaig two-year po«KCondary customized training programs. At the 



mt teveU die «ic&»ce imdmtes those individuals wiio bave responsibiUty for working 
widi stale sy^ems of two-yew postsecoadaiy educatimial instituticms to admifiista' aiHi 
evaluate cnslKiiized training. Depending upcm tl» stnMmue of the state, these a^icies 
may be linked to state offices ctf higher ediKation or state boards of schools, or located 
elsewhere in state governmental bureaucracies. Further, the responsibilities for 
^indnistratimi ami evaluadon may be shared across these and oihet stale agencies. For 
state a^icy ofiBdals who often have expertise outside the fields of postsecondary 
cdiK»ticmcw program cvaluatioa,titt operational dcfiniticm ami conceptual framework are 
httsded to in c«mducdng process ami outcomes evaiiation of custcnni^ 

An impoftant secoiK^ taii^ aiafience b educational ^cninistnM! wittdn two- 
ye» pofitsecoiuiaiy institmim thonseives, espedaUy indvicfaials who have r^ponsibility 
for ^amdns,<Wivefii«. ami evaluating custwniwdtraiiringiHPgian^ Wherew some of 
the ittfoiniAioii contained to the ctmcqmiai fimnewoik n«qr 
a system ctf two-year postsccondMytortitutioos, the vaan^fority of tteqm^^ 
appl^ to coltegiaiie4eveli»ogiammatk; activity as weU. At fl»lw»l level, evaluation con 
be used to explm die impact of programs, to produce information for program 
inqyrovement, and to show die ways in which prograne are accountable for producing 
ben^ts for individimls,flinis, communities, and Evaluation of customized training 
am also be used to d^enm^ ways to make tx^tional postsecoi»iary education p^ 
more useful ami relevant to client i»cds and instiUitional missions. 



Organization of the Publication 

The four remaimng sections of diis report preseiU infwmation regarding how 
custcmiized training can be ctefiiKd ami a^«ptualiz«i to provide a basis for evaluation. 
The next section describe tiie {socedures used to devekn> the qjcratiwal definition and 
conceptual ftamcwork for evaluating custondzed training. Section diree summarizes 
UtOTisw dial di^nes and desciibM cu«iHnized training 

iiwtituikas across die United Stat». This section also presents die five-part <^icrati«»l 
definitkmirfa^omimitiahdng developed tiaoi^diisiao^ Sccdcm four discusses tte 
puiposes for devdoirfng a «»ceptual framcwiwk awa itecribes ^ 
a resutt of die devdopnotolwwk undertaken diroughtiUspio^ Fmafly, the last section 
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ptesems a «iinii»iy of the qwratim^ d^nitkm and conceimial £ran»work forevaluaiing 
custtOTiizcd training. 



PROCEDURES 

Tl» qperetionai defiiUtimi and conceptual fianiework for evaluating customized 
training were developed thnnigh a four-phased developmental pnxress. The process was 
de^igiBsd to imitate outing tton^ical and empirical inforaiation in onter to create a 
conceittiial model fi^imdentanding cosltmitel training ami evaluating its relationship to 
econiHiilc (tevdo|mi»it The pioce^ was ctmducted with a high priority for obtaining 
review and feedback from ioc^ experts hivolved in adnunist^ng customized training 
I^pograms. 

Tbe Developmental Process 

The four-pb^ed process coimsted of ( 1) condiuning a review of literature on broad 
topics associated with editf^^ion ami eccmomk; dev^pment; (2) (tevel(n>ing a preliminary 
concep&al fiamework for custrnniasd training; (3) obtaining review ami feedback regarding 
the fnm^work and comlm»ing a focus group interview with expwt practitioners and 
admittiMton ctf customized tiainl^ in the Mid-An^tea Training Group; and <4) refming 
the opoinicmal definiticm ami ccmceptual firamewf»k jfbrcustcmi^^ 

Literature Review Process 

The theoiedcal and onpirical lit^atme leviewal reiaesrated several subject matter 
areas associatfii with vocadmial edu^on, custmnized training, economic development, 
and po^^econdary education. staffcomlucted a broad sweep of soinces pertaining 
to these » w in seaich (tf retevam infiwmatioo to Iwlp in cTKiting the op«ation^ 
andccMK^mialframewi^ Literature in these areas ranged from bdng quite theoretical 
and abstract to being highly practical and appUed. Howevw, the presence of research 
i^aicd to relalfoadups between postsecowlary vocationd «li«ation [MOgran^ 
customized tndning. and ecwmmic development was limits in scope. Therefore, 
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afMHionml 4^ cftHactkm pmcBaeg were laed to obtain the information nested to develop 
the opecaticmal definitkm and ccmc^mal firamewc^ 

Initinl Dmiopiiient of tbe Framework 

Tbe pn^ect staff ejiainti^ various (feciston-ori^ited evaluation mockis such as the 
CiHttcxt. Input* ProccM, ProAaa (OPP) Evaluation Model of Stufflebeam (1983). In 
a(faffik»i, ^fevtewed liimttuie in the arn of i^nerai syst^ 
means of coocqmializhig the evalu^im of customized traimng. Project staff further 
levieived die lenilts of a pfOfe^ condi»:ied by CamiMl ai^ Pai^^ 
of prognan quality fiarvocatfonaleducatiwi. Each ctfth^iesouicis testified an approach 
that was use^ in (tevdoping die opmtional definition and concepmal framework. 
Analysis these tteoiet^ aid evahiation nio(&^ pioAK:ed a syst^ f^ 
vttiaUes and examhiing xelati<mslUi» an»ng sets of variables (i.e., inputs, processes, 
outputs) to ^oenidn die mttuie and vahie of customized trahung. 

The Ii^Slal Review and Focas Group Interview 

Many local experts involved in two-year postsecondary customized training 
contributed to dUs dcvdinHiwntel proass. Thrae individuals represented fifteen two-year 
pc^tsecmKlaiy educational instttudons that are mmnbers of a consortium called the Mid- 
Anwfca Training Gioiv. The histitutfons involved in thfe group pooled resources in 1985 
to (to an oigaitotkm itedteatcd to irffeing training to larg^ 
ind^N&iwest Eachnrariwiscommiiiedtoenhaia^ngitscapaaty tojsovi*^ 
tiaming and tedmical as^stance to business and industry. The foUowing institutions make 
up die Mkl-An»kaThdidi^ Groiq): 

Cuyahoga Cromraunity CoD^ Oluo 

Des Moines Area Onnmmiity Colte^, Iowa 

• Eastern Iowa OsamunUtyCdl^ District Iowa 

• Giaml Junior College, Michigan 

• KeUoggCcmonunityCo&getMkAigan 

• LorafaiCominui^CoUege,(%io 

• Macomb Ccmnmnd^O^ge^Midiigan 

• NfilwaukBeTecfanKal Institute, ^^^sconsin 

• MmaineVall^ Community College, niinds 

• Nofdi Central Technical O^Jege,>risa}imn 
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• Rodie8terQ»niniiiiityC(dl^Ohio 

• Rock Valley Ci^ge,BU«»8 

• Sittdmr Qmununity College, CMo 

• StLoiiisCtoainiiii^Cc^ii^t^iissoiai 

• TdloaCdle^IIIiiiois 

The jnresidents and business and industry training directors from each of the 
institutions participated in the various developmental phases of this project These 
iodivkiuals piovkted feedback and leconuneixiations regarding ti% validity and utility of the 
opmticKial definition aikl conceptual fran^woriL Some of the fcwiback was provided by 
teams of customized training unit staffs from the Mid-An«rica Group institutions; others 
leaded hidividually based on their own experiences with and knowledge of customized 
training. 

The Foctu Group Intertiew 

Building upon the initial review process, a focus group session was conducted with 
the busincM ami Industry timning direcKHS of the Mid- America Traning Group on July 12, 
1990. The session was approximately three hours in length. The procedure used followed 
the methodology recommended by Kruegcr (1988). This approach entails a group 
interview conducted by a skilled interviewer or interviewers in a permissive, 
nonthreatening environment Krucger advises that the group discussion occur in such a 
way as to allow comfortable and enjoyable paxticipadon from all memters. Kruegcr 
lecomroends the use of a structured interview guide to provide a general questioning route 
throughout the session. 

An interview guide was developed by the project staff prior to conducting the focus 
group. The general questioning route for the focus group session is as follows: 

1 . What kiiKls of programs and services does your community college or technical 
institute offo* as part of customized training? 

2. How does your college or institute administer, develop, and deliver customized 
txaUui^? 

3. How does your college or instimic evaluate customized training programs? 



o 

ERIC 



13 

8 



4. What tecoinii^idati«iiis do you have for improving the propose operational 
d^tton of cu^SMitei tr^nin^? 

5. What recomnmndalions ito you have for improving the proposed conceptual 
fiaisewaic fiMT evalifittiog oistxmdmi 

Plowing the focus gnmp raton, the infonnation obtained from the group was 
incoipofBiedh^ the qmttonal (Coition and c«iceptua^ Then, this version 

(tf the ctefinitifm and frameworic was circulated again to the Mid-An^rica Trmning Group 
paiticipants fcH" aiK>tl»r round of review and fccdb^dc 

Later Developmental Process 

From August throu^ Dmmber. the project staff concentrated on further 
ctevelopn«at of the opraatiooal (^nition and conceimial framework. A version was 
conq^tcd in mid-Octobw and reviewed by the Mid-An^ka Group ex^ 
speciaUze m admhdstration, resi^rch, and evaluation of customized training programs. 
Cnnimftiitu obtained fiora tl^ reviewers expanded the operational definidon to include 
additional criteria and provided fimter evidaice about ways to clarify and expand the 
conceptual framework. 

Umitatfons of the Procednra 

Thb ^ject represents an initial effort to develop an evaluation approach for 
customized training itelivwed by two-year postsecondary «liKjational institutions. The 
pioje«a was intended to Itocus on the <tevelopnwBt of a cOTce^^ 
a foundal&mftff later devdojOTiKtt of program evaluation sira^ra and tools. Theprojcct 

diiectore recc^nize the i«ed to operatioialize tiie concepts prcscnt^l in this report and 

whcrfdieartedly «Mtoe tl» effims of iwUviihials wlMj wim^ 

to use the fitanKwwk w a basis fw stale- and local-levd evaluation of custonuzcd tr^ 

In ^tion, tiie ccmasptual ftamcwork is likely to reflect the cxpwiences and 
expotise of pioject staff and uutividuals lejscsaiting tiw Mid-America Training Group. 
Wheim these cxp«icnccs aie ttought to be pertineitt to customiz«l traimng jwograms 
thfDUgiK>«t the United States, ackiitional review and feedback is needed by expats across 
the United States to ascertain ti» vaUdity and utility of the conceptual framework for 



evalnatioa piirp(»es. FM^,ieview ami fieedft^c^ from state pt^cy^^ 

tevd voattkfflBi ediKatkm direciDfs iroidd also 

of dtt comr^mial framework fc»: use by vocaticmal edifi:atc^ 



AN OPERATIONAL DEFINITION OF CUSTOMIZED TRAINING 

Customized training prc^rams have enierg«i over tlw past two decades as two-year 
postsecomJaiy institiitioss have umeadagly served toirm aid imii^ry. This secdon 
provides a bf^descri|ytkm of Ikh¥ the ci»txHniz^ 
United Stales, llieiitfuieofciistomiiedtrahiingimgraiiui^dsti^ 
In addidon, dds se^ion provite an overview of tte leladtm^ps between customized 
training and ecoiKmiic dev^>|mm by pdnting <wt die ways i^ 
isseenu«dia]^ngpaitkularecoQOii^(tevekipin»it^rategies. FmaUy, die operadonal 
o^inidon of customized training is provided as a basis for subsequent discussions about 
the evaluadon of custmnized traming. 

Tbe Status of Customized Training 

Customized training is mn a new comxpt for commuidty college In the late 
1960s, many community college in tbe Soudi offiered spedaliz^ traimng for specific 
firns as part of an ecoQon^ devdqnnatt slr^^ m hire fro^bdit firms u> waiiz^ cU^ 
(Jacobs & Koddo:, 1987). Souttem states provided job training for firms at local 
comimmity coUe^ or tedmical institutes whraiindimd^ was willing to id For 
example, the Carolina college systems were created widi an e<»nomic development mission 
as dieir fouiMiadon opposed to a transfer roissicm. The trahdng programs were typically 
short tarn, widi die ^aies payhig for in^nn^ tteUvoed at eid»r colleges or employer 
sites. Daring die 197&, en^toyea were often (»id by state ca- fiedcral Comprehensive 
Educatkm and lYaining A(»(CETA) funds (Warmlmxi & Faddis, 1983). 

Many quesdoin were raised about these early short-term traitung programs. 
Incfividuais ctidctoi die efifom becai»e ttiey feU dnt tocal govermn^ 

real training costs for companies (Pincus, 1985). In most cases, however, die training 
prt^rams re pr ese n ted ^tioastato by educate in response to d»econoiiucdevelc^mient 
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stmegies of state polfcyniakefs. These custimiiad training programs usuaUy involved 
ediicatoisatoi«wim«aieeconoiiiK<tev^^iiemai^^ Tl»pn«rams wcretaigeied 
I^imarUy at smaU* and n^dtom-idzed finns diat could not have affbnfed viable training 
Olsons for their wiarkforces withmit assistance from the cummimity college training 
programs. 

Later, the ei»noraic problems of the 1980s led many two-year posisccondary 
institiaiiffls tfmwghcmt tte United Slates to fbUow the eartier leads of c^ 
states. Stales hani-Wt by tl«recessicm in the manufacturing ecoM 
year po^KCcmdary histitutions as a way to retrain la»iK>ff WOTkess ax^ 
B«sii»ss ino^singly viewed colleges as amvmcnt plac« to pmchasc firm-specific 
txainmg programs. With fiscal crises and shrinking budgete Cwdng nM»t public educadon. 
two-yesff poslsecondaiy u»timdCM» were responsive to efftaris to retrain die workforce. 

The ctevelopment of cu^mized training in the Midwest was prompted by the 
economy's downturn in tte early 1980s. Three strategies were implemented in Michigan 
that were iUumtive (rf efforts initiated in the Midwest to fwrifitate two-yrar 
ofaication'sinvolvememineccHiomfcdevcU^HnCTL First, the MUAigan community college 
assodadon developed a poUcy statemiait sF»dfyhig die role of tte colleges in economic 
deveh^nn^ Second, an eccmandc development n^wwk w^ established to promote the 
reladonship betweei the colleges aiui tte state ccononuc development effbr«. Third, 
colleges began to take nwre systematic approwAes to development of ties widi local 
business and industry. 

An early examiMtion of dw mvolvonent of the Michigan community coUeg^ in 
economic (tevdopmoit revealed ttmt in 1980-1981 about twenty-five hundred employers 
paid fordurty diousand of didronployces to take job inqm>venMait clmes in dw coUtges 
(Packwood. 1982). Later, from 1984-1987, whUe die nurah-r of «uctents in traditional 
vocatk»al edwation courses teted by dght pecojt in Midd^ 

ttairung units imtoted a fifty-six penult inwease in enroUn^t a ^987). 
AldMW^ enrolUn«it tirads in customiiKd trainmg are unavailal^ on a nation 

data from dus Midwest state Ulustratcs die growdi diat has occurred in demand for 
cu^ndzed training courses in d» United Stales shice die early 19^. 
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Types of Customized Training Programs 

Tl» smsd goals of custimiized mUaing imdativ^ usioUy focus oa employers' 
Deeds. Customized training as defined by Gnibb and Stem (1989) is "relatively fiira- 
specific sldn tndi^ for individual films, and th»ef{^ a fbi^ 
speci^dly responave to a film's req u ire meu ts than are g«mi vocaticmal programs" (p. 
31). Fixm use customized tiaiimig as an im:eQtive to attract or retain employee or to 
cre^ new voituves widiin communitiei, ^t^ or regiims of the country (Flynn, 1987; 
Gtul^ A Stem, 1989). To be dl^ve, customized training products and services must 
reflect the diversity of CTipkiysn' needs. 

Employers and tl^ eniploye(» seek cu^onazed training because it is specifi(My 
tar^ted to thdr needs and designed to be appUed imn»difuely to employees' jobs. Many 
indivtffaMis who paiticipaifi in cu^imniKd training abotdy poss^ specif ^dlls to carry 
out jobs in the woricfoice. Tl^ involven^t in cistonuzed training is to gain skills and 
knowledge to update, retrain, or advance in occupations. In these cas^ customized 
traintog dxsm education and iNKtness ainl industry more closely togeti^ fcH* tte purpose 
of economic development than do other forms of postsecondary education, including 
lnKfit&)oal vocatkmal-tedutel educatii»u 

Even tlxnigh cu^imiized tiaim^ within industrial firms invariably deals with new 
techttolog^s, rarely does a finnc^ its wmkfMceiieed only technic^ trainings BasicskiUs 
^Smtion and managem^ training are fiequmtly r»ected by a workf(m» ami can be 
defivond through the custon^Eed trabtmg im^rmtt two-year postsecoiKi^ 
This is eq)ecialiy true hi snail- and medium-»zed firms that lack the resources to provide 
cc»n|)rBhen«n« mferoal traMog o^m. Two-year postsecondary institutions can provide 
content de«gned to hnprove ttie basac ssea^m^ skiUs of <:mployees in the worki«»ce. 

Nearly a decacte aso, Tkmd I^ce (1983), then Executive DirectiM- of tl» IlUnois 
Ccmununity College Board, described a key role of commudty colleges in et^nomic 
devdopmemasoi»ofpn>vkiingbasicskii]s(teveh^mMfi[tf the workforce. HejKimted 
out that buaness and mdustry simply could not be Mghly {m)ductive withom work^ w^ 
possessed the ccmipetend^ to perftem basic compot^wis and read basic instructions and 
du«ctions. Basic skill (teveli^mient rqiresents an often overiooked component of 
customized training; howeva, it is of critical importance in providing employee with a 
foiffldaticm f(^ tbs qiecific tedmk»i ^dlb trainmg necessary fw many of today's .pbs. 
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Cnstimiiwd Traiiiiiig ami Ecoimii^c Development 



Economic (tevdlq|»s^ is process of expanding prodiartivc capacity and 
impcovingtheqoatityof lifeinaciHmninttty.anarea,(M'aiegi^ Ithas 
two importam omipraents: (1) economk growth (ix., increasing employment and 
eamtegs). and (2) ccHnmunity devek^nnent (i^, improving the quaUty of life). Economic 
deveiofHmt is viewed as the proc^ of creating and retaining wealth and jobs by 
nK>Hlizing a|^Mcq[»iate rmucra to expand the maritetable products ami services of a 
community. The three majw^ials erf eoMKmiicdevelopmwtt may be ctefiiwd as human 
developn^t* job development, and community (tevelopment (Leach, 1987). The 
devdi^mient of hmwm ie«)ttK»8 through education ami trainh^ 
inaei^ the capwity of commumfe to export ^Kxis and serviws, thereby ireweasing 
their procbictivity and wealth. 

Vocitti<wal etodon, partkarfariy custmniEed trah^ 
ecomMnic itevelopmrat ancc it has the potratial to directly a^ 
piochictiv^. Cusaaatodtrainmg can have ttepotwitialfbriwaeadng the sw 
and services produced with giv^ resomces and for iiwaeasing ONP without mcreasing 
IHfcesorfaiftetton(Grobb&Slwn.l^>, It is a nwans of sthnulating growth by assisting 
^ledfic firms in paiticutef segnwnts of the economy. When stale subsidiw are doubly 
lev^aged (i.e^ firms are reqinred to mati* state ciMitributimis with cash or real in-kind 
soviet) for specialized tnihiing,eccmondcbei»fitsaccn» to the states (Bailey, 1990). 

Bailey also points mit a "trickle-itown" effect wben large firms nsquire their suRjliers to 
partidpsse m customized training. Tte b&mRts of training, in ttesc casw, accrae to an 
entire group of firms hivolved in dimlar sectors of the labwrmariti^ In turn, customized 
training can play a role as a "border scout" for traditional posts«:ondary programs. 
L0»ons teamed thrwigh customized training can aid hi driving curriculum change and 
sometiinesdevdf^Hngnewcurricularpn^rams. In a sense, aistoraijod trauung programs 
can be market probK for vocational edi«3tfion, creating a mems for recruiti^^ 

traditional cc^^ate programs. 

By uring customized training to r^n wihIcws, firms can obtain a relatively 
hiexpensive mctlwd of providtag th^ wiHta with tlK ddlls aiKl 
be more prodiwtivc hi their jobs. Further, customized tiaimng with the pinrpose of 
tctrain«« an alreacty experienced wwkfwce has the advanta^ 
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it is relativdy less eiqwmive to tfam expemnced workers than to train ii»xp»ieiiced or 
unskilled individiuds. FnithCT, tiiis r^Mixce in community coUe^ allows firms, 
espedally raudter fiims, to concentrate flieir ei»rgies and creativity on their primary 
missioiis as qqxsed to getting involved in the education busing 

Economic Dmlopmeat Strategies 

The foltowing tteee mtegies can be employed to reach the goal of stimulating 
ecoQcmiic gniwdi in a community (Goetsdv 1989; Grubb & Stem, 1989): 

• Recruiting l»mne» and indi^fix8nodx9rre^k»» 

• R£tafaiing.ejq^andii%, or revitalizing eidstuiglwdness and ii^^ 

• Devi^q^g new bii»nKS and indussiy 

Customized training can play an important role in each of these strategies by enhancing the 
capabilities of busine^ ami uuhistry to produce products and services and bring greater 
wealth nno a connmudty, state, r^km. 

ReenmsMnt of Busittess and Industry from Othsr Regions 

This strategy occurs wl^ co^ bk towoped as a meam of attracting busings and 
industry (paitiailarly »naU- ami imdium-sized firms) into states and conmumities, when 
training is subndiKd fbr firms moving inm a state or IccaUty to r^i«:e txaining-rBlated 
idocatkm costs, or whoa state-fumted^ training ^ograms are made available through 
sudi piogiams as customtal traimng (Grubb & Stm 1989). Empirical r^ulte indicate 
that these recruitment strategies can be effiective ways to attract business and industry. 
Plant and Pima (1983) fbmid tihat sta^ that spem nmre money on ^ucation also 
expertoicedhigho'ectmomic growth rates. New industry has a multipUer effect on the 
local economy in tlutt jobs are created, whidi causes wages to be paid to workers, who, in 

turn, spend these wages f(» servto in the economy, thus stimuladng the service sector. 
Manufnmnhig firnas are cf^ftoed to be vali»-adc^ to the ccmu^ 
produced and ejcpofted to tnii^ dolto bad; into the community. 

Retention, Expansion, or RefUalkation of ExUdng Business and Industry 

This second major tstrmgy is ctesigimd largely to jnevent )ob loss. It has the 
advantage of ineventing die high cost of diskscation. Custtmiited traimng is used to either 
retrain ui^nuie the ^dlls of «npIoyees of an existing firm Jt it is (Signed to rapidly 
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aialdei^eii4>toytes»>playaiolehianeiq»u9dliigei^^ While this strategy can be 
an exiieiiiefy cfBective menis of keei^ finns in a comnusmty. it tyjHcaUy |»odiK»s few 
nswjt^ TheiiiiixHtKiceofjobfmitioiiiiitistisotbeiimtere^^ For example, the 
toss of a pUmt of five thoisaiKieiiqiloyees is of greai» iini»»t than ti« creation of a five 
hundred imtallatioa. 



Detelopmem Sew BatUfesi «md Indmstty 

The fliiwi miyar ^ratcgy is emptoymost creation through the development of new 
business and industry. A high quaUty «iucalional system, including two-year 
postsecondaiy ediK»tional institutions, can play an important role in stimulating 
entiepimuf^aaivityinacomnmntty. Two-year poslsecomlaryinaitutions often operate 
smaUbusiiM(tevdq«nf^cOT!ers and oto service for Io(»lentrepieneu«^ Many times 
custmnized training is packaged with these services in such a way as to stimulate new 
busii»ss dcv^mmKit (ICTB. 1987). 



A Search for a Definition of CustomiKd Training 

Aooss the United States and withm regions and states, custonuz»i training ofiered 
by two-year poitsecondary educational institutions has cUfferent missions smd g(»ls; 
funding somees; clirats; adroinistratiw stna:turc8 widiin two-year institutions; staffing 
anangeoKnts; and processes of marketing, dtevclqmi^ in^)lairaitation, and evaluation. 
The foUowing defiitition from die ICCB (1988) Ulustrates die breadtii of programs and 
^vkes thitt ans conskleied a put (tf cisiXHnizBd training m niinob 

rraining Mt^rams pTOviite the Imaness with ex»:tiy the land of 
traiiting die fta needs; wluaever the subject matt^. ^ college can i^gn 
or broker a trahdng program to fit the 1»1L Tte «:hechile aiKi (hiralion of tiie 
training are totally up to tiie bi»ii^. Most customize training is 
condiK^ on site at die conqrany's f^ti», but training also can be 
condi^ted on ^mpus or at any off-campus site. The instructors are 
spedally choM depemfing on tte company's needs. Most fiequcnUy, 
in^r^m aro e3q)«t i»actitim»rs firom die fi^ who provi(te the actum 

experasQce. 

Such training is provided under contract to train new employ^ and 
imgt«te8kiite(tf exiting employees to maintain or iffiseaseprcmta^^ In 

many cases, txMag is {sovided in mtkg to amst widi a plant locaticm or 
expansion in niiiKiis. Ccmununity colleges regularly assist busiMss^ 
seddng training dtrougfa various state programs as well as Uirough ttie Job 
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l^raiiiing Padacrsh^ Act (JTFA) where tte vast mi^ty of the training is 
pokifiMTl^ the company itsdf. (p. 3) 



The nUsois report continues by outlining the types of diverse economic 
develoj[»nent ^vities in which its community colleges participate, with one section 
(te&ntediocumnbedtfaining. Thbsectkm identified the fcOiowing types of activities: 

• Qx^JOBdi^ with ecmomic develf^miem instititti«is. 

• Asd^ing with ecoimlciteveloimiemdfbftstttt» local levd. 

• PartttipatfaTg in leading industrial r^ntion, expandon, and attrition efforts. 

• Trailing both on- and off-site. 

• Ticalnh^ new oiqiloyees and oi^rafSngsidlls of exi^g employees. 

• As^^ing tai«ne»e8 seddng funding fof training. 

A lecoit study of customized training in Illinois confurmed the wide range of 
trainhigasdeduattional »!rvices cteUvored by niimHs conummity colleges (Bragg, 1990). 
Thioi^ a siffvey, representatives tl» Illinois colleges descri 
cu^mni^ education and training, ranging from staiKiard credit-geneniting college courses 
to mHi-ciedit technical and managerial training. The rcspomtents also indicated that they 
s^^ed eitho' cdtege faculty or ci»^tams to deliver training and that the training was 
offered mi campus or at aiq>loym' Io^chk, depoviing upon employeis' nmis. 

At le^ two other stai^ have stiKliedtte customized trahung programs offered by 
their two-year institutions. Tte results of sti^Ues cimfhicted in Califcmna and Midiigan 
ccHifim the diqmity in the ways col^^ in these two states d^Sne ami (^}erate cu^ 
tndning. A imidy conduct by Yoimg a^ Company (1986) repotted that community 
coU^ in CaUfomia c^)»ated contr^tual ed»»tion very <filfimidy from one anotter. 
They found that the courses offered as customized training could be based on existing 
oil^e courses or modifications of college (»urses. Fuxtho:. the clients of customized 
txaudng were toiness- or maioigmmt-related firms rato tlum manufacturing-related as 
was o^ espoused by many of the customized training units. 

A stalewide study in Michigan (Jacobs, 1989) ran into {soblems det^mining the 
tevd of cnstomizBd traimng oaivity offered by its comm^^ 

reci»ds i^aidhig mm-oedit off^gs. Withom dus type of data, Jacobs was unable to 
(kxnrnioit the full scope of tte NUchigan colleges' customized training activities. At the 
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li»rt of tte pioUem was that Michigan colteg^J lacked a common definition, record 
maintenance, and reporting pn)ccduies for customized training. 

These stinto do ctmfinn the wicte range of education and training programs that 
constitute ctiffmmi^ tiahiing. They also point out a immber of questions that remain 
imanswoed. Wh^sarvicesM into the doaudn erf custimiittd training? Can off-the-shelf 
training tegitimately be considoed cu^omized training? What information should be 
coHected to documa«d»fim«aH««»d impact of cusaimizedtrain^^ Answrstothwe 
qiMSticms are oeetted to clMriy d^be the contributions of two-year posisecondary 
institutions to economk deyek>{mia)L 

The Operational D^lnition of Customized Training 

One aspe^ of customized training in wludi there seems to be agrremcnt is the 
iffic^ty for contracts between iwo-yw posts«:wMlary institutions and their clients. 
Yc»mg ami Con^my (1986) d^Kd atomized training ^ contract^ 
col^ pcr^amd who iHovide specific training for jaivate ccmi^ 
paid to the coQ^ Folate and Wint» (1988) defined cu«onazed training as synonymous 
with contract courses. Ttey indk;atc that two-year institutiwis contract with businesses, 
unions, and non-profit <»ganizations to recdve s»te aid on a fiiU-tinw equivalent (FTE) 
ba^ for dedgnhig and ctelivering firm-specific training. Jacobs and Koehler (1987) 
coiicurred tfutt customized training is tlw outcome of a contract b«ween the coltege a^ 

cUcnt. Similarly, tlw Ohio State Council on Vocational Education (1987) indicated that 
schools enter into this form of scl»ol-busim»s relationship when they "enter into 
coittiactual afrangranrats with a particular lnisir«ss (or group of iHisincsscs) for sjwcialized 
training snvices" (p. 1 1). 

This point of agteen^ about the necwsity for contracts provide a starting place 
for an qjerational definition of customized training. Qeariy, the (ksvclopnumt of formal 
contracts ditoeitiates customiz«i training fam the many othor educational ^c^ of 
two-year postseciMidary mstitutions. Tl» five-part ctefinition developed in this project 
begins with the concept of a contrwit and aiMs four c«her important dunwisions. The 
d^tion spedfies that customized trainhig requires flie following: 
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1. Comr^s-^to written or vcit>aJ---betwccat«^ 
bist&utto anl ocimM citeats tD secme dev^ipnio^ 

tfainbig. Tfa emiMlB amy ^vt otdusive rights to ext^^ clients to the 
informatkMi pnxhiccd aiKl(teUver«i in custcmiizedi training {sogxams. 

2. PaymeBts between extmd ctiotts^tha {mbUc or {nivat&^-and two-year 
postsecoiKlafy insiituti«is spcdfkd moducti aiKl smices. The payments may 
craiB (&Bdly from iiicS vlifaiab cff oigid^E^^ 

behalf «^iMlier iKfivlGbttis or oii^d&itic^ 

5. RdBttaosiiips to econmte developneiit stratus whereby the intended 
efifiKt ctf customised ti^hig b to imivf^ ii^ 
let^R^ ea^aistiiig, levltalii^ bis^» ami indus^ 
nid hxhitfty; or cicating isw bi^iiess inid iodiistiy. 

4. The delivery of training that is designed to improve workforce 
CQB^eteiicies of taiget pqw^ons assodaied with extonal dibits. 

5. Adaptation to the n^s of external clients whereby two-year 
po^secoiKiaiy instituti(»is deliv^ training ix ^ixrattcnmi products aixi service that 
to^ w mndiffeatiiffi to meet d» paitiaiiar weds of the external client Theextait 
of ads|Nation is baaed on needs assmiffint «k1 mstiiM^tional d^gn methoctologies. 

This five-pait defitdticm also jmvides dw foumkiticHi for components of the customized 
training process desoibed in die cmqmiai firaniewaic bier hi ^ 



Contracts 

An essential comp(ment of customized training is that it is initiated through a 
contract between two-year pc»tsecomiaxy institiniOTS and uk extonal cUeit (e.g., private 
finns, labor unions, public agencies). Often, contractual arrangements make information 
deiivosd hi cu^onnzed trainhig i^ygranas the im^)^ Individuals 
associaled tw^year in^inakms ac^ cm bi^c^die dienis to a^ in tte devd 
anddeliveiyoftl»pn^stetaryhiff»n»tion. Wl«n tins infwmadcmbecon^^ exclusive 
right of the cii^ conmuinity college cannot incorporate the hifonnation into tteir 
tradilfonai edncatinnal pn^rana. 



Tte goals oScmioadxed tnuning programs are negotiated throu^ a process that is 
tyi^ally fig nme ccmytet flian a simple handshake agr»ni«iL ComF»:ts i(tentify the 
namie of die process to be used to dev^ and deliver cu^omized training. Itaefbrmal 
agieenients lypUly comain many tis lic^lowing it»ns: 
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• Lo^ftftovoNanemiiitteiiaitiiasMp 

• t^fies and times c^traioingcouise 

• Ei)ii4isi»it,lai)i8at«ie8,arfiKmtiesm 

• Descripltois of tte d)jectives of the custtanized training program 

• Descriptions of the tasks to be accomplished through the customized training 

• Ntmtecrf trainees 

• EvaluatKm m^&ods 

• Instnictorqitttificati(»i8 aiKi sdectioQ {»t)ceduies 

• Mechanisms for bc«h parties to agree to new or adjusted conditions to the contract 
Payments 

pByroents made by clients oiaMe two-year institutions to recover expoctditmes for 
ftfj^f^inifteying, (feveli^ng, and (teUverisg customized training. If no public fiimis axe 
invidved. the mo^ ctmiOKm ^JimMch to d^enniiu^ 
detmine aU antidpated diiea costs «id an iiKlirK:t rate b»»d on tl^ co^ ^ 

oveitead (Clailc 1984). Direct costs for customized training oftoi it&huSc tte following 

• Hours of instruction 

• S^ttdm services 

• Books «ximatsiais 

• Facilities aiKleqiupn^usa^ 

• M a ih et ing 

• liffitxuction ami materials (tevelopment 

• Pre-craployiwnl screening, counseling, or assessnxni 

• On-tto-job training 

• Contracted services with j^ofessional consultants 

• Adult basic echicatioo 

• WCTdrfbroe a s s e s anoit 

The isices set by two-^ inioituticms for customized tcaining ^moaUy fall below 
the prias charged by private vendors for similar types of trwning. Two-year 
l»«second&iy testitutiw flic of ddivwing the tr^g at lower pri^ 
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trainiiig vemlors or internal training units because they can utilize their existing resources 
(Le^ £Kmlty, an^iun. fiBdUtte eqti^mifiat) tt> ddim Ftnth^, many 

tialiiiiig |B«^[raiiis are siiMSzed by pal^ 

publk cellars utiUzed to lediHrette overall cost of training the w(^^ 

Relatioashi^ to Econooiic Developm&at Strategic 

OmmdsBoA training programs are deApmd and delivered as part of a well-devisai 
ec«Mmiicd6vdopa^pc^(brapait^ilaraHnn»i^ Ttoeisadear 
mis^ taiw^ved tlie tnOning diat links it to a laiger goal of eomcmiic devetopn»m 
ami as of a bro^i» gov^nn^ntal policy to foster economic growth. A two-year 
postseccmdaiy ii^tution can beomtt an arol^issafkir on behalf of tl^ community, state, or 
legioo, 11iet«KHyearpo^ecfmdBiyinstituttona»i^tl»]Nivat!e-sewfitm^ 
ftimn its goals and, in tum, the two-ye»x in^tution's link to goveinn»ntal agencies 
jawidcs a fte«uice for in^wiving d^ 

Delivery of Training and Education to Improve Workforce Competencies 

Customia»d training offers a variety of programs and services that aid an external 
client's mganizatimi in re»:hing its ecommiic potential Customized training is (tesigned to 
improve the capabilities of a client's organization to produce goods and services in an 
efHciem manner. This can occur through improving employee's basic academic, 
managerial, or technical competencies. The product or service delivered through 
custc»nized training is designed widi maximum attendon p^d to producing these outcomes. 
In doing so, the customi^ training unit is an extension of the two-year postsecondary 
fnf?fif^tiT*!t'f pdiiffftf*^^ pmgrntm and ««vicea- Ths instimtion's invoiven«nt with a client 
may be for customized training and evolve into other education and training products and 
services si^ as technology transfer. This enables two-year posts«:ondary educational 
institutions to pioviik a range of products and services to meet clients' needs. 

Adaptation to tbe Needs of External Clients 

Tte five-part c^jraatiaial ctefinition of custMnizcd training allows for a broad range 
of services as part erf cu^omized training. incUiding boih credit and non-credit training and 
education courses. Furtfao', the (tefinition allows fw a diverse set of activities to account 
for customization, ranging from conducting needs assessmrot to designing entirely new 
currknila to (Bering stantol ciB<m-gcneraling collegiatc-level ccwrres at employers' sites. 

Of: 
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To fintlier (fiffeimti^ ti» nm^ of training ami education ap^oacfaes that are 
GtHisktad a pait (tf castonM tiainiiig, tte 

• Oiem-i&dmaAonHtBsignoltiai^cmtM 

• Modification of training CTHgses 

• AlienitfivedefivayoftiaNngcoiffiMs 

• Training courses fx special pojMiladons 

CUeni'Mvem Cmaom'l^^ited TnOttimg Courses 

Hic fim ai^ROi^ 10 cutiomized trainbig invcdvcs training products and savices 
developed for an external cUmt, typically using needs assesfment, instructional d^ign. 
tiaintog iteUvwy (c^. cbsaoom iMtnictioB), and evaluation. The product m service 
lesuWag Ihffli tte tesmictiMal dedgn Kid <fcUvery iKOC^ is original 
the propel^/ rfthcdtent 

Mod^kaUon ^ TmM^ Comrses 

A sccomi ^>|mch to customized training occurs wto eiusting cu^ 

corns or standard two-year arfl^iatc cour^ are adapted to suit a particular client's 
needs. Ty^aUy. inoaM trainmg proAwts ami servic»s take 1^ time to 
cuMomnie^gned traii^ couTMS, hitt stiU provide conteit fairly spedf^ 
pait^^cUenL Often, acadernicf^ bask sldlbdevek>im»nt courses faU into this categ^ 

(tf appioadties to cnstcffltdzed trabdng. 

AUenmUvt iHttvery of Trabiiag Courses 

A fldrd ai^mnch occurs wh^ stasdard «)ltegiaie course or existing custoniiz«l 
training prodwrts and swvices are jaovicted through deUvwy methods otl»r than those 
tyiribdiytocdinatrwiitiimalcidle^coiase. Exani|)Ies of alternative deUv«ry training is 
fftofntiwifti r>^ia«i>«iwk jawided at a dient^ location, on we^cmis. through alternative 
histnu:!^ roefliodidogfcs (e.g^ tetecwifawicing. a^Menticeships), or through restricted 
access to the ges^ l»ibUc. 

TrMug Courses for Special Populations 

The fourth apjaoach involves trming products and services developed and 
(teUvcred fi» spedal population grou|». These programs are frequently sponsored by 
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govenuDe^ in^ts stidi as tob 'Mning t^utimhip Act (JTPA) programs or state-level 
ecoiioii^<tev^k^iieiitgovemiieiiialagaic^ This apfson^ tyiricaUy target ctisplaced 
wiMtas and otto individuals withi special nmis for training to obtain or retain 



THE CONCEPTUAL FRAMEWORK 
FOR EVALUATING CUSTOMIZED TRAINING 

The conc^nal fitan^woifc |»oviites a means oi stiucmring sets of variables that 
coiikl he nsed to desoibeaiKievahiaiBqwdi^oiitcon^sielatBd to customized It 
also {Moviites tlw s^ of variables (i.e., economic ^vironment, customized training 
IHocesses. imfivhtoal an|^>yee cnm^mies) ami elem^ts needed to cate^^ 

to cvahiaie customized tnnnii^ 

Systems Theory and Decision-Oriented Evaloation 

The conceptual fima^work fw evaluating cu^omized training evolved out of three 
tfae«etkalDioddsfi«rofga^ziiii(ffevabiatingconqd»systans. Systons theoiy provided 
a wmcqmial nmiel for viewing die cusicmiized training ptoonKiion as a complex system 
with it^itfs, iHOcesm ami (Niqiitts. Cbeddand (1972) cteHned systoms theory as the 
"conqta gioii{^ of lumian hehigs and madm»s f(^ whM^ ttee is an ovoail ob^v^^ 
(p. 91). Jacota (1987) further defined a system as "characterized by inputs, 
tma^Jimmkmal processes, oittpi^ and a feei&KdL ^an^ 

a dgml to comrol die in^ of tl» process* (p. 2). TMs perspective provided a way of 
thhiking about aisiimiized iraimng as a system that exins widim 
ecmMmdc wiroonant). widi specific inputs (e.g^ woAfofce competency deficiencies), 
processes (e.g^ trahdng delivwy). and (mtcwnes (e.g., employe outcomes). 

systms dieory as a foundation. SlufQebeam (1983) <tevcloped tfjc Contati, 
IniMt, Process, ami Product (OPP) Evaluatiim Mwtel for use by educational decision 
makexs. StnStUieamvtewed the four components (^d»mo^ as discrete areas in wtudi 
eduKtffonal itedsions are made, which led to four types of evaluation as jart of die 
msO^ OPP IHW^ a uscftd example of a means of relating conc^ to die cvaluatimi 
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of a piiticiilar efbicatkmal prognm such as ciistoim»d toMng becau^ it iUustmed the 
types of data airi evaluation im»duira that wcie c«»is^ 

aod ^odm evaluation. For sample, StufHebeaiii <tes;OTbed the chaiactcristics of 
ittstttutioiis and targ^popidatioas as paxt of context He identify {HOC»lural design and 
imjricniGaation as coMistenl with procesa«. Furtlwr. Slufflcbeam viewed outcomes as 
part of Ihe gMOBl TO <rf jmxhicta, whcidjy (Wtcomes were 
andprocashifbniiation. Tto way organizing infijnxutfitMabwtt a complex a 
piognin sw* as ct^mnized tnuning into c«Mnpon«its that could be evaluated provided 
inlonnatHm us^ in dedgn^ to c(»Ke{mi; I fitainewoik for this 

RnaUy. CampbeU ami Panzano (1985) ctevcloped a coiM^ptual framework for 
evaluation of vocatkmal program quaUty based largely on systenM theory and uhe CIPP 
Bvahiatifm Model CaitTbeU and Panzano developed a cwiccptual fraroewo A org^ 
sKmd three tos^m cat^wics ktoifled as connsit, educatiimal cxperi««e, and vocational 
outconus. WitWn the amttxt category, the scu of variables included individual 
diai»:teri8tics, community settinp, and labor market conditions. The educational 
expniem category was cteoibed in terms of tte «hod context and school process. 
RnaUy, in iclatoiship to vocational outcome, individiral and sociml outcomes were 
uteitif^ The c(MM»piual&anwworkdevi^>ped by CampbeU and Panz^ 
flwidBM that have evolved throughout this project Sinulaily to the franffiwork developed 
l^ Campb^ and PanzaiM), this cwicqjtual fran«work for evaluating customized training 
evdved wifli context, edia3«i<»al experiowx (i.e., tlw customized training procf s and 
(Hxtcomes as central tl^mes. 



Overview of ttie Framework 

Based on tlw operational definition, a conceptual fran»work was develoiwd to 
describe the teycompo^ms of customized training. The com^mialframewOTk provides a 
schema for categoriang sets of variables and clcnwnts that can be used to conduct 
systematic program evaluation of customized training with the goals of improving 
im)grams, araesang impact aixi developing and maintaining records that dcm^ 
accoumalnltty of Ujc two-year postsecondary institution's cimoimzed training programs. 
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The con^ptual framework ccmtains s&ts of variables associated with context, 
process, and omcomes. The level aiKi scqpe of (tetail of infonnation neected to collect data 
fOT each ^ of variables (^peiKts vptm the nature of the customized training program and 
the piopose of that evaluatioQ. Tl^ sets of variables are Mkea (town into iUustiative 
^nio^ to i^ ISQvide a Gompidienrive desaiptk» of in£^^ 
describe the nature, extent, and 'mpact of customized training. Bgure 1 provictes an 
overview of the inajfH' cst^OT»s of v&riaUes designated as contm, process, and outcomes 
in the conceptual fiamewoik. 

The Context for Customised Training 

Hr^ ccmtext reflect the ch^racterisdcs of ^ates, communities, insdtudons. and 
events that hiflume the way ctmomiz^ training proce^ws are carri«i out (Figure 2). 
Fuiti^, tiw sm of variables assodated with comext help desoibe the onvironment for 

ioffivifhials uid fiiii»/agem^ IB (^^ts. to two-year postseccmda^ 
m service provklMS, and to soci^ as a whole as a result of customized training. This 
part of the conceptual framework helj^ oeate an understanding about the anay of 
chaiacterifito witldn the oivironment, both indde and outsi(te of two>year pos&econdary 
tnstitutiotts. and ti» ccmtext for custondzed tmimng. 

The context fi» custwnizcd training is viewed as being composed of three 
categnies of contextual vaxbd^ 

• Economy enviffDnmem 

• Educational msdtudons ami systons 

• Bn^h^eeandemidoyercluuiKteristks 

Eadi of these sets of comextual variables ccmsiste of elments that dooibe the environmem 
in which customized training is coiKiucted. 

EconomU EnHronmgni 

Economic environment is the first set of contextual variables. Economic 
aiviiottn»m idemite the past, cunent, and future condition of the local, state, national, 
and intenaticmal economy. This set of vari^les jnovides a dncription of the economic 
setthig in which custwnized traimng is conchicted. The conceptual frameworic proposes 

on 
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iJmtfoiirsrtsof mustialivcctenimsielaiedtoccom^ The 
fifst wtt of is identmed as imficators of local, state, national, and intenuitional 

ecoiKmiic omcfitioiis. THs set of vaiialto piovkfes \tes^ in the ecommiy tanging from 
the cimimmlylcvd 10 tfje global mariErtjdace. Exainr' -sof mdicatoreofAcmtcmational. 
imtimU state, and local ecomamc ccmdition are load, ^tc and natiwwl imemploymeni 
rates; trrads to ONP; kx»l Im^i^ voIiuim; and local, state, and nationd 

levels. 

Governmental polk^ and programs in the area of economic (tevelopnwjnt are the 
sfconA set of etemffists leUttti to tt» economic environn^t. This categwy provides 
inftmnaikm about the specific fedocal state, and local pol«acs and pro 
stinnilatetlte economy. Jc* irahiing jrograms fimded at the fiederal- or state-level su^ 
JTPA w its state-level equivatoits are ejtamples of programs with a g<ml of stimulating 
eoHKHnic devdofHiwit tioOTgh improvwMts in wmkfiwcc competerary. When collecting 
toftoialkm residing ilttse policies and pix^rams, it is inqwrtam 
and scope of the various strah^ used. It is also oitical to <teteimii«s in what ways tiw 
strategies may be conqjeting or confUt^g, tteicby impeding opportumties for economic 
devdt^mntt. 

The third aiKi fourth sets of elements id^ficd are characteristics of the local and 
stetecommunity. Similar i^iwmation needs to be n^asured in relationship to these two 
entitss. ThisinfornMrtionu»ludesthe(temograplucchanttteristicsof titepo!^^^ 
types of dcmmiantlHisincsscs and induces, labcH* supply, a^^ It« 
Uupoitant to eicamine trends in this date to detramine how die economic environment of 
sped&: «alBS and comimmities may cfmss over previous years ami is likdy to change in 
tfie future. 



EdmcttHomU Imtimtions and Systems 

The seoJiKl set of variables is ti» area of ediaational institutions ami systems. This 

set of variables descnTx» tite past, current, and fimne state of educational sy«^ 
diaract^^ of two-year po^secondary histitutiwis at«l customized naming units witiiin 
them. Tlffi intatt of this cati^ory of variable is to ejtamiitetite scope and purpose of the 
various ftf«««iHaimi mstitutious and systems in relationship to economic ctevdopmrat and 
customized trumng. 
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11» fiist of Uhmnttive etemotfs idn^ed as part 0^ 
systans is iteKribed as tte pd^es, pit^irams, and The 
category of educational systems refers to tte local-, state-, and fe(terai-level systems of 
public or private eductttonal oiganizaticms at die secondary md postse»)miary levels. 
Some eauuDpIes of the infbrmatioo that needs to be analyzed include the mission, 
phitosc^^dcal perspectives, historical involvement, adimmstradve stnicuires, leadership 
cmnmitmeitt, and ^lan ci coBSx6k of die educational sy^sms in relattonship to ectmimuc 
devtik)pniait ami, ini»e^»ecifiaaiy,ca!mmiized training. It is useful to examiiK the ways 
in wtudb tte misdon ami goals of educational systems omflict or compete in meeting 
ecDiK»nic development goals. 

The secoml set of elonents is ctoacteristic of the two-year postsecondaiy 
institution's pol^Stfaograms, ami pra^to. Some mmi^f^inlfbimation that needs to 
be ccdkcted are d» level of leacto^p ommiitm^ to customized training widun die 
infft^tftfi^; die nature of (tecisi(»i-maldng processes concerning customized training (e.g.. 
centralized, ctecentralized, or integrated); the level of supp(Mt for customized training from 
ite p muiicuts across d» college (eg., teoad-hased ornanowly-based support); tt» nature of 
mission statements including focuses on economic development; and the level of 
insdtiidond ftexitriHty oiabling cimoniized tiBinmg fm^ran^ 
of external clients. Th^ elements illustrate die type of information diat needs to be 
cdlected widdn two-year imdtudons to (ktomute die internal environmental context for 
customized training programs. 

The duid set of etonents d^bes d» customized training unit itself. Example of 
infmittticm dial is neeited are die admlnimadve and organizadonal strm:ture of die 
customized training unit; leadership commitment to meeting economic development 
obiecdves;aoddiet»p(nisiymi»of die unit's intonal poikn^, practices, and programs in 
meting dkatt nes^. It is also impw^ to ctomine die gemal ways in which a unit's 
internal oiganization^ stmctnre ami proc»^ (eg., (tesign, develqHi^t implonaitation) 
are conducted to umiersand die ways external client needs are idoidfied and addiessed. 

EmpUfyft and Employer CkametsrisHcs 

The durd set of contextual variables identifies information about employees and 
d!^«nployere as external cliwits of customized training prtJgrams. This set of variables 
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m^nvniG PROCESS 
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OUTCOMES 



Individual 
Employee Outcomes 



Employer Outcomes 



Industry Outcomes 



Educational 
Institution/System 
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Societal Outcomes 
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Cofltextiial 
Variables 


Illustrative Elements 


Economk: 
Envinsimcnt 


• IndicaK^ CH mtematuHud, national, stale, ana locai ccHimnoiK. 

• Cioveniniental eamotmc (kvelofmient polides aiKi ptogFEuns. 

• State chaxtK^oi^k^. 

• Coomninity char»»m5ta^ 


Educational 


• Educational system pohaes, programs, and practices, 

• Two-year institutional policies^ programs, and priKtices. 

• Cuscmnzed training unit adnwusoativeorganizado^ 
leadMship, stnKture, policws, pro-ams, and practices. 


Instin^ns and 
Sysistos 


En^toyeeand 

Empkjyer 

Qiar^eristics 


• Qiar»:t8istics of c^pnizaticmai (ranployar) clients. 

• ChaxacteiisQcs of individual (emitoyee) cUoio. 

• Relationships betwera two-year instimtions and clients. 



Figure 2. Cbmextual Variables for the Evaluation oi Customized Training 



34 

29 



consdtiites tte diaracteristics of isdividiials, private-sector organizations, public-sector 
agmies, and otter types of institutions Umt receive custmmzed tr^ning products and 
services in exchai^Ee for paym^its to tlw two-year postsecond^ 

TIs first set of el^noits associated with en^)toyee and employer characteristics is 
(tescribed as tte characteristics of imtividu^ clients (i-e., employees). This category 
provides an ovenOI descrii«k« irfen^ili^ees dial are tyi^caUy smed m 
progrBTOS. Son» exampl«i of information needed are gender, rape, ethnicity, age, 
educational tevd, ami ocoipasiosal level In ai^tion to this infi»mation, it is important to 
obtain an understanding of tl« general nature of the job pCTforroance deficiencies of 
cmphyees in onfer to (tengn a letevant training {HOgram. 

ThR second set of illustrative elen«nts is identified as the characteristics of 
or^nizational clients (i.e.. raiqjloyers). Tlus set of elements provides a description of 
public and private orgamzations that have hists»ii»lly sought and arc cunentiy secWng 
ctt^omized training. Son« examples of tte type of information that would be collected 
indude the types erf burinesses, iiMJu«ries. « jniblic ageiHd«; tl« size of 
the types of occup^om ranirfoyed in tlw wwlrfbrce; tJ« types of technologies utiUzed; the 
level of involvement of labw unions; and tiie general nature of workforce skill 
requiren^ts. Similarly to tiie previous sets of elements, more information can be 
identified and coltected to provide an uncterstanding about the specific environmental 
context for puticular custsmuzed trsming jm^num. 

RnaUy, a third set is the relationship between two-year postse«)ndary institutions 
andwtemalclfents. It is important to obtain information about the historioil and prwent 
nature of relatiomOups that exist between institutions and clients in tijc delivery of any 
training or education s«vices, cspedaUy customized training. Within this set of elements, 
it is iriq)cmam to <fiscOT tlw scope awi natme of prior airi current partnerships bet^ 

educatiomd institutions aiKl extwual clients. Some of the information that is m^ed 
inch^ descriptions of iwrtirahips tiiat have occurred, asscssn»nts of the quality and 
cffectiv«iess of previous partn«shi|», and the level of cooperation and coordination 
associated witii previwis and current partnerships. Without doubt, the history of the 
partnershii^ between «iiK»tional institutions and extwnal clients creates different 
enviro nme nt a l forces on ciHiem and fiitureCTistomizcdtrainmgtw^^ 
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The Cwrtonlxed Traiiiing Process 

Second, tiie oistomtol txiining process involves the entire scope of administnitive 
and q)eiBtk)iial sub|»ocesses involved in inocbidng ami deliv^g tl^ various customized 
training apiHOKhes (Figure 3). Through the sul^MOC^ses (e.g., c^ign, development, 
evaluation), customized training programs evolve. It is necessary to understand these 
sul^processes to itonmne ti^ httpoftance in prodiKing cust(m^ 
to as8e» tte rdatioi^iip proem to outcones. 

The cttsti»nized training proc^ in its most nidimemaiy form is composed of the 
fc^kming three m of vui^)tes: 

• Cl^ needs assessment 

• Qmmnizedtriimngsubpocessa 

• Qsiomized tndning/bducatifm ap{»oaches 

CUent Negds Assessmemt 

The Grsi variahle ictettUi^ cliem i^eds as the starting poim for the customized 
tiauih^ process. Client i»eds may be idraidfied by ^ employer before U» initial contact 
by the tsw-year postsecwutaiy mstitution; other times, tw>-5w po««^^ 
identity mds through a formal needs assessment Ktivity. Often, cli»its (to iK>t know the 
extent and nature of the training needs of their employe and rely heavily on the 
instittttim to identify and itesign customi»d training programs that enable them to reach 
(te^red goals (ix.. incaeased productivity aiKl profits). 

The mient of identifying client needs is to recognize employee performance 
deficiencies that require remectiation through an educaUon or training program. This 
{Hoceduie hidintes the mtfim of truning that is i^eded to inqm>ve in^ 
and overall oiganizi^cmal productivity and i^oGX. It is important to document tte nature 
and scope neecb an»sment jnocesses used to ictentify indivichial oi^jloyee needs. 

Job performance needs may be associate with the three areas of academic, 
technical, or niffliagaialkiK>wtedge and skills. Academic knowled^ ami sldlls relate to 
such areas as math, sdem», and commimicatiims. Technical knowledge aiKi skills are 
associated wifli excorting job-specific tasks, especially those involved with the use of 
technologk»lbifofniittion,mataials,andeqinpn«it Maragwial knowledge ami skills are 
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used to fttffirtioo cffe«ivdy and efliciCTtly wiiWn the w(Hiq)lacc. incliKUng competency 
dev^ipmem in the aiaa (tf sdf-rosaag^nait, ckci^ nakii^, and t^m problem solving. 
It is impcmant to spediy accwatdy the nature of cliem needs in order to ensure that 
oistoinized traiidng ap|»o^ies are <tev^^)ed and cteUveied. 

Customized TrainUg Subprocesses 

The second m of |»ocess variables is the customiied traimng subproc^s^. It is 
impoitam to obtain an iButatanding of tt^ way in which the following subprocesses are 
executed to prochicc particular q)|m)Kte to customs^ 

• }tegotiittionandc(»macting 

• JiAanaly^ 

• IMgnanddevek^aiiou 

• ImjAocnenfittioo 

• Evabiattoi 

Two-year postsecondary instituticms i«ed to docun«nt the nature and scope of the 
^Oqmjcesses in idtoi<H»hip to the various customized traimng approaches and subsequent 
mmwmes. It is also iwcwsaiy to collect information related to tte relevance, efficiency, 
ami of execution of the various subt»oc«s». Through data coUection aciiviUes, 
in^tiakms can klentify ways in whiiA sul^mx»s«s produce custom 
that result in specific outcomes for individual employees, employers, cducaUonal 
institutions, and society. This data can also help two-year institutions structure internal 
oiganizatiottal and whmni^vc process^ to facilitate efficient delivery of customized 
training imigranis. 

Customized Trminiag/Education Approaches 

The third set of ^ocess variables iittluctes tte customized training approaches that 
evolve from the maibiHocesses. These aj^woactes are grouped into four categoric: 

• Client-Kirivai^custonHte^gned training courses 

• ModUkation of tr^ningfeducati:^! courses 

• Alternative delivery of traimng «Harecs 

• Trehdi^ courses f(ff special populations 



37 

33 



Eadhof these aiq8oadi» was (tescriMimviously. They can be used inctepeiiciently or 
joSmfy to describe inm^ activity ifteiiiified as 

Whra oi^Bli^ iiif(mmai(» abom the various c^ 
impoitam to estabUsh a set of ailBda that can be i8wd to detmnin^ 
IHOgnna horn the perspective of the stakehokta, in this case the external client, as well 
astbetwo-yetf postsecondaiyimtitittUms. Some i^iteria that can be used to deienoine the 
(pialityofcastomlgedtg^iingiwdudtethefi^^ 

Origioamy 

• Appwyiia tCTB >s t 

• Jdbidevaace 

• Specificity 

• Compr^iensiveness 

Flexa^ 

• Re^xm^veittss 

• Aocmacy 

• Tim^ness 

• Cost/benefit 

Tbe Outcomes of Customized Training 

Finally, outam^s are associated with the various target groups for customized 
training (Hguie 4). The friunewocfcic^fles the sped& types of <Miti»mes that are likd 
to occur f^hidividuals, fimis/^^mte, educational iiBtitudons/systenis, and society as a 
Gonseqp»oce<^l^ quality mtomnedtndnhigprograixa. Coining a better m^totaiKUng 
of tte ways customized training inflt^ices these outcomes is important. The sets of 
(Hiicomes vaitoUes are categorized as foltows; 

• Individual employee outcc»nes 

• En»7byar outcomes 

• Industry outcon^ 

• Educat»»ial institutifm/syston outconss 

• Soctel oufiEtmies 
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Proceas 

Variables 


Illustrative Elen^nts 


CHent 
Needs 

Asssssassnt 


Neech asse^ment to kiontify 

• AcMfemk; knowted^ and skills 

• TechmoU krowledge and skills 

• Managerial kiK>wtedge and skills 


Cu^onszad 

'naimng 

Subpns^ses 


• Negcmatkm and contracting 

• Job ai»ly^ 

• De«gn and ctevdqmiKit 

• Impl^^mBntatiixi 

• Evaluadcm 

• Adzmniaration 




• C^ieiK-drivaB custonH^^&ned tiaining ccssrsiK 

• Modi^»iionitftrainuig(^ education courses 

• AUonativedclivtty of tnoning coarse 

• Traimng courses for special peculations 



Bgure 3. Process Variables for Evaluation of Omc^mzed Training 
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IndividiuU Employee Oaieomgs 

Tiie fast stt of oittcome variabtes is d^oibed as individual employe outcomes. 
These vaiialto may occur for individual employee as a result of their participation in 
customized training programs. The first set of illustrative elements is in the area of 
competes^ (tevetopniRil, ii^udmg conipetei»:ies in m^ademic, technical, and managerial 
aieas. A second ^ of iUustrative elem^ d^cribes individual employee outcomes in 
tenns of financial rewaid, indteiding higher wages and better benefited 

A dilid stt of denieits relates to employees' bppoitunities for career <tevelopment 
or advancem^it ami alt&native or improved employn^t opportunities as a result of 
involvement in customized training programs. Finally, the fourth set of elements is 
ii^itified as die area of job salisf^nton. Infonnation collected about job satisfaction can 
provide a nttans of (tetpmining tl» ways customized training influences individual 
emi^toyee satkfoction with a job or overall employment »&u^on. Customized training may 
also increase the ability of the two-year in^tudon to act as an arm of goverament to 
respond to die interests of business, thereby providing responsiveness to major 
constimencitt in the community. In this way, customized training can become a 
ctmiponent in the overall human r^oim^ ^rategy of government 

Employer Outcomes 

The second set of outcome variables is associ«ed with the employer. Evaluative 
hifi»roaifea is needed to obtain an uwteistanifing of Uk benefits th^ acc^ 
public agcndes, and j«her cUort wganizatiom as a rKuU of customized tTMning pn 
The fiftt set (tf^ments relates to the area of enhaMcd prodwrtivity and profits for the 
organization. It is Importtnt to detwmine the ways in which customized training 
contributes to prodiKSivity and profits, including detennining die ways in which the 
coUectivc in^irovemait of employe competeioy and productivity influence production 
levels, the ways inimd trmning costs are lowered by using two-year institutions to deliver 
customised traiidng, and the change in competitive iwsition resulHng from customized 
txaining pit>grBm 

Anotiicr important element is tije stability of employer organizations witiiin 
pMticularc<Mnmimitfes,stai».wrregioi»(rf the country. Information about chan^ in the 
competence of the workforce, turnover rates, or productivity levels related to customized 
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tni]iiiig]»rogrBimaicmqxHtantioimcten^^ A third elenmtt associated with employe 
otitconies is ejqpaiision of ba^i»ss asd imtustiy. Tbh elenttnt ideatifi^ the extent to 
whkh economic growth tor paiticular firms or a^nci«5 can he related to customized 
trahdng. 

Similarly, tte fbmth c^aM idemite the arm of adiqitability, including tte ability 
of a finn or agei^y to be rei^Nm^ve to me^g the needs of its identified client groups. It 

is Impolam to dbleinyne tte extern ID firms and a^i^ 
deliver dtfleiem products mA services as a r^t of their employees participating in 
dtttmnized training. The fifth el«i»nt is the area of empl03^ morale. This element 
piDviites eviftence of the collective attiti»ies of employee toward the em|doyer and the 
overall work environment Any dianges in onployee nunrale that result from customized 
training jm^rams are in^XKtam 10 idemify to btf^er und»^and 

InduMtry Outcemss 

This thiid set of outcomes is associated with businesses and Industrie that are 
gr«^ di» to tiidr jm)ximity, similarity in purpose, or pam^rship rclationdups. For 
»ample, small business siq)pliCT relationships that exist with largo: indu^rial flmts are an 
exampte of the nature of the oig»nzati(ms being ^Idressed with this set of outcomes. 
Generally, a similar set of elonents neois to be (to:ribed in relationship to industry 
ouicoii»s as was (fescribed previously for employers. The elen»nts associated with 
mdt^ outcomes (ie^ prodi«tivity. stability, expanston. aitofHability, morale) jaovide a 
means {^descrit^g ti» (mtcomes for grra{» of iHismess and indui^ flnm 

EdueatiomU InsHtuHon/System Ouieemes 

The fourth set of outcome variables are educational institution and system 
outt^nnes. This set of outcome relies to changes in the two-year postsccondary 
fthfffff^i sy^»n and two-year instituticms thomelves as a result of their invdven»nt in 
offering cai^imiizwltiainmg to external clients. The first set of danents is associated with 
jmjfit, specifically tl» revenues institutions receive from subsidized or nonsubsidizcd 
jmogiBntf. 

Tte second set of elements sunounds the area of change in policies, programs, or 
pi^lices m i^aticH^ip to their involvement in custmnized training. Sonw examples of 
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Outcome 
Variables 


Illustrative Elements 


ImBvidual 
Emptoyee 
OuteCOTKS 


• Oonqpetency develf^nneiit 

• Financial reward 

• Qoeoracivancsnient 

• Job sadsfacticxi 


Outcomes 


• Productivity 

• StalnUty 

• Expansion 

• AdaptabUity 

• Empbyee nxjrale 


Indu^ 
Outcomes 


Spill-over benefits among »nular firms in 

• PnxhKmvicy 

• Statslity 

• Ex;»nsion 

• AdaptabUity 

• Empbyee nwale 


Educational 

Institutsni/Sy^em 

OuioHnes 


• Profit 

• Oumge in two-year institution prograins,polides, and practices 

• Change in rdammdiips between two-year institutions and clients 


Societal 


• EasMmik: (teveloimient 

• Quality of life 



Figure 4. Outcome Variables fiw Evaluation of Customized Training 
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infofinatkm needed i*aii»es in steffing; cttcrfculum; oaollinKits; job placonent services 
fiv gr^luaiBs; ios^tutiml niisnocs; lesponsiveness to community needs; aiKi relationships 
to private aid pubfic ocpi^zBticms within ccmmi^ 

A thiid set irf etoems is the changes that occur in tte relationships between two- 
year po^secfHuteiy institutif»is and »tenial cUots. It is important to detune whether 
niftwfff^ training stinuOatw improvements in the types of partnerships that occur 
b^weenhntitntifmsandcUentsinvidvedindKim^ams. Soii» examples that could be 
ised to aoBtify positive changes in relatimidups imihide evidaice of inoMsed enroUment 
of anptoyees of ejUcrral client wganizations in otl«r traditional cdiKalional programs 
offoed by two-yw institiitkms; IwightKWd hivolvcmait of employee of external client 
OTganiz^oQS hi cuniculum (tevelopment aiui improvement efforts; priority hiring for 
gr^hiates of two-year postsecondaiy programs; increased mtwnships ot apprenticeships 
for two-year postsecowlffly ^utots; and uMarrased equipnient donmions. 



Societel Outcomss 

The first set of outi»me variable exammes the benefits of customized tnuning to 
soctety as a wh«rie. m intent is to identify outcomes pertinent to individual citizens, 
communlti«, aiul states. Within this area, it is important to identify the economic 
coiuiitio^ of the community and state that may be influenced by the customized training 
programs p«>vided by two-year mstimtions. Information collected in relationship to 
economic cooia&m can be UKd to desaibe chffligcs in tte local, state, w regii^ 
mat could potentially be attrilwrted to customized training programs. Examples of these 

elements aie the Ic^wing: 

• Pn^jCTty values 

• Cc»nmnnitysupp(»tfcffediuation 

• Econraiic growth 
« Ecnmik; staHl^ 

• SnploymcntraiEs 

• Local badness volume 

• TtoialBS / 

• Average salary tevds 

• FtaentagBctf the community living public as^stai»» 

• Services jaovided for spedfM: companies (i.e.. induccnm jHOgrams) 



43 

41 



Fiially , a 8ec(»d 8^ of ^nems ctaribes infom^ 
in the quOity life fc^ dtizais in a imrtiailar conununity or state where custonuzed 
txainingiscmidiK^ Although titescclonciits are difficult to measure, they arc importanl 
to besm to exaDuae in <mto to gain an uiKtotaiicfi^ of tte 
OQSOi^asawfaf^ Exan^c^infonnatlra that couM be collected are the foUo^ 

• Sodaldtoitfe 
Political st^iUiiy 

• Bnyironmentai services 

• Govenimeatal service 

• Law enfofcemeitt 

• Infrsstructures 

• Sdiodsystnns 

• OveninoilKaicenM of sldUedworicSnPce in theisms 



SUMMARY 

EnmiiHis growth has occurred in tte customized tnuning conducted by two-year 
post»condaiyedttcat»inalin^tutions. Although customized training appears to make a 
ctmtribution to tte range of educational {soducts and services offered by two-year 
pffltfg^y ffm^ mgritntiftrat, ihtte systematic evaluation exists to explain its hnpact cm clients, 
commnmties, states, or tl»in^tuti{»sth«nselv^ This project was a^gned to create an 
openuional defimtion of cimti^nizeri training and to devek^ a comi^ptual firan^woit fc^ 
evahsOingitshnpactand^SDCtivmss. Tteprim»y targ^aud^icn for the project are ti^ 
^ate-tevd admit^traiive agm^ aod two-year po^seccnsiary in^tutions r^ponsible fm 
evaluating the contributions of customized ttaining to economic development in 
cranmunittea and states. 



An Operational Definition of Customized Training 

The lack of common miming for customized training leads to misinformatioQ 
among cdleges, clients, finuiers, and poUcymato as customized tniinmg is planned, 
delivined, and evaluated aaoss the country. Since e«»iomic ctevelopnwnt is a primary 
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force bffhiiid mMim^Tf^ training, ske^y or subjective evifteice abcHit its effectively in 
ff^tpiiii^ng jgnpkiymefit in conmamities or states may Ifaut fiiture puMic sapptxct 



I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 
I 



One aqMCt of custimdzed tmning in wiiich ttere seems to be agreement is the 
necesdty fc» fbnnal contracts bmmi coUeg» and their clients (Young & Company, 
1986: Jacobs & Kiidder, 1987; Folate & WintCT. 1988). This pmnt of f^reen»m provides 
astaithigidaceforanopenaii»^definitkmofcusSiMnizedtxaiiu^ Ttefive-(»itdeflmtion 
devek^ in this project begins with the concept of a contract and adds four othw 
inqxntam dhnsBSons: 

1. Cteiiracts---^tl»rwntten or v»bal--b^ween colleges 

2 Paymms bet«^«i college and extmial partiw— either public or private— for 
prodn^ and scrvicw for identified target pqjulations associated with the cxicnml 
pgaties. 

3. A rdati(Hiship to ecoiKsmic devdopn^t strategies. 

4. An objective of improving the knowledge and/or rfciUs of identified target 
popuMons assodated with extend paxti^ 

5. Spedfidfy to the needs of identified taiget populations associated with external 
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The Conceptual Framework 

Given tins definition of customizwi training, a conceptual framework was 
developed to d^be the key compoiwnts of cu^mi«d training and die reiatiimships 
among tl»c(»npooents. The amcqmial ftamewoit contan» Kts of variables categorized 
in terms of omtext, proc^ outcomra. It provides a ba^ for identifying clemaics 
Meded to de«»ibe tf» nature, extent, and impact of customized training. Byuangthe 
conc^mial ftamewiak, ^ agenda and two-year posts«»ndaiy institutions ran develop 
program evahiatiim tools and iwoccmm f w detwmining die imjact of customized traimng 
on the economic well-being of communities and states. 

Rnt, die conceptual framework contains sets of variables that can be used to 
describe the context for customized training. These sets of variables reflect the 
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dniacmi^ks of ra3]doyees/!Hiis^ym, instUutiiHm, comimiiUties, and states that (Hovide 
tbe Ini^ fi:ff tbe way cu^imiized tndnii^ is coiHii^^ Tte variables associated with 
contesct cImBlem tte !^ aad i^ksol ecom^ 
educational systems; aad fee roiployees and onpioyers as clients. 

Second, tJw cu^omized training pmcess involves tlw entire scope of administrative 
and opoatioiial subpioces^ associated with prod]»:ing and deUvering customized 
tiai^ig. I^i^nlly the a»tDinized training imess b^ins ^ 
external Uie&t aiiftieiice and tlMM proceeds diiough vari negotiation/ 
contracting, job »iaty^s, instmcticMial c^i^ and envelopment, implmentation (i.e., 
training delivoy), program evaluatifm, ai»l administration. The customized training 
aj^[Hoachcs that result from the suI^koccssw arc listed below: 

• CtottHfrivencustimi-dedgBed training i^oducts/services 

• Modl&d training or eitottionsoiBces 

• Alternative deUveiy training pioducts courses 

• IMung courses for special populatio!» 

Finally, it is i^c^sary to focus on the outcomes of customized training to 
omSei^and how cu^imiizedQ:8ining relates to ecom)mic development It is also important 
to il^eimine bow customized training prochicts are Unted to outconi^ for individuals; 
firms/ageiKies; groups of firms/agnicics that make up the industrial sod commercial 
economic bases of eommunitte regions, ai»l stales; two-yotf institutions tl»mselves as 
pnyvifters of cuslonsized tiamteg; ami tte soct^ as a whole. 
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